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PREFACE 



The following report serves as the Quarterly Report for Contract 
NAS9-15476 which is entitled "Analysis of Scanner Data for Crop 
Inventories". This report describes the work carried out under that 
contract for the period 7 March 1979 through 6 June 1979. 


Work on this contract is performed in the Infrared and Optics Divi- 
sion directed by Mr. Richard R. Legault. Dr. Quentin A. Holmes is the 
Program Manager for this contract and Mr. Robert Horvath is the Technical 
Manager. 

This contract is part of a comprehensive and continuing program of 
research concerned with advancing the state-of-the-art in remote sensing 
of the environment from aircraft and satellites. The research is being 
carried out for NASA's Lyndon B. Johnson Space Center (JSC), Houston, 
Texas, by th@ Environmental Research Institute of Michigan (ERIM) . The 
basic objective of this multidisciplinary program is to develop such 
information systems as practical tools which will provide planners and 
decision-makers extensive accurate information quickly and economically. 

Substantive progress was made during the reporting period on all as- 
pects of the current year's program. In order to clearly represent what 
was being accomplished and why, a somewhat unique format was used in 
orally presenting the ERIM work at the Supporting Research and Technology 
(S.R.&T.) Quarterly Review held at NASA/JSC on 4-6 June 1979. A running 
narrative was presented which simultaneously highlighted technical pro- 
gress and showed the interrelationships between the various tasks and 
subtasks. This narrative was Interspersed with six detailed technical 
presentations treating topics in greater depth. The materials which con- 
stitute this Quarterly Report are the visual aids in that presentation. 
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OVERALL LONG RANGE OBJEGTI VE 
OF 

LARGE SCALE REMOTE SENSING 

Development of Global Environmental 
Monitoring and Management System 


COMPONENTS OF AN ENVIRONMENT MONITORING 
AND MANAGEMENT SYSTEM 

t Information System 
t Forecasting System 
t Decision-Making System 
• Management Actions 

Development of the Information System using remotely sensed and collateral 
DATA is technologically REALIZABLE AND DRIVE OUR MAJOR RESEARCH GOALS. 

Development OF other systems is equally critical. 

Current activity is directed to monitoring crop production. 
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CONTRACT OBJECTIVE 


Advance the state-of-the-art in extracting information 

FROM REMOTELY SENSED MSS DATA AND COLLATERAL DATA, FOR 
THE PURPOSE OF CROP PRODUCTION FORECASTING 


TASKS 


• Objective Labeling Technique Development 

-Objective; Develop the technology to accurately 

AND OBJECTIVELY LABEL SCENE ELEMENTS BASED ON 
REMOTELY SENSED AND COLLATERAL DATA 

• Machine Processing Technique Development 

- Objective: Create a machine environment for 

EFFECTIVE LABELING AND FOR THE EFFICIENT USE 
OF LABELS IN A LARGE-SCALE CROP PRODUCTION 
FORECASTING SYSTEM 


Term 


CROP PRODUCTION INFORMATION SYSTEM 


STRATIFY 

AND 

SAMPLE 


WORLD STATE MEASUREMENT 


SAMPLE STATE MEASUREMENT 


WORLD STATE 
ESTIMATE 


SAMPLE 
ESTIMATE & 
AGGREGATION 
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SYNOPSIS OF TASKS 


Objective Labeling 

• Feature Definition 

- Spectral/temporal/spatial 

- Landsat data structure 

• Signature Characterization 

- Crop specific/temporal trajectory statistics/generalized signatures 
.§ Labeling Techniques Development 

- A I aids/machine labeling/understanding labeling errors 


Machine Processing 

• Data Normalization 

- Landsat calibration/atmosphere effect correction 

• Stratification^ Sampling and Estimation 

- Field definition/bias and variance reduction 

• Error Model Development 

- System analysis /performance measures 

• Test and Evaluation 

- System verification/generate new hypotheses 
f Advanced Technology 

- Critical analysis of future needs 


Teibm 


OBJECTIVE LABELING TASK 


• Major Elements: 

- Feature Definition 

- Signature Characterization 

- Labeling Procedures AND Techniques 

• Focal Points: 

- Winter Wheat 

- Spring Wheat and Other Spring Small Grains 

- Temporal Characteristics of Spectral Data 
and Relationships with Collateral Data 
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• Featuj?e Definition 

- UNDERSTAND STRUCTURE AND CHARACTERISTICS OF SPECTRAL DATA 

- Determine features extractable from Undsat and collateral 

DATA 

- Determine agronomic and physiological significance aNd 
information potential of features 

• Signature Characterization 

- Develop generalized methods for describing features 

- Develop normalization procedures 

- Select features and understand interrelationships 

• Labeling Technique Development 

- Develop improved image products and labeling aids 

- Develop objective labeling procedures 

- Examine labeling error patterns 



FEATURE DEFINITION 


Objective 

Derive or Determine Discriminative Features for Use 
IN Labeling Scene Elements as to Their Crop Type 








FEATURE DEFINITION 

Approach 

Understand Temporal. Characteristics of Spectral Data From Wheat 

- Study CROP CHARACTERISTICS 

- Generate and analyze simulation data 
“ Analyze field measurement data 

- Analyze Landsat data 

Understand the Structure of Landsat Data 

- Develop relationships between in-band reflectances and 
Landsat data 

“ Study relationships between: 

Landsat bands 

Landsat band ratios 

Combinations OF BANDSy SUCH AS THE 
Tasseled-Cap variables 


FEATURE DEFINITION 

Approach (Continued) 

Define Features for Crop Detection and Identification 

- Time. profiles depicting green development 

“ Time profiles depicting crop ripening and maturation 

- Distinctive characteristics of those profiles^ e.g. : 

.. peak green and day of occurrence 

.. DAY OF EMERGENCE., HARVEST/ ETC. 

.. RATES OF GREEN-UP AND SENESCENCE 

- Contextual features 

Determine Agronomic and Physiological Significance of Features 

- Agricultural practices 

- Soil effects 

- Drought and other stresses 

- Relationships to collateral data 


FEATURE DEFINITION 


Progress 

Understanding Temporal Characteristics of Wheat Spectra 

- Formulated SPECTRAL PHENOLOGY MODEL 

- Began analysis of USDA/Phoenjx reflectance measurements 

Understanding Relationships Within and Between Spectral Data Spaces 

- Studied Landsat bands and band ratios vs. Tasseled-Cap variables 
“ Related in-band reflectances to Landsat bands 



temporal characteristics of wheat spectra 
William A. Mali LA 








raPOf^L CHARACTERISTICS OF WHEAT SPECTR^^^^ 

Objectives 

• To DEVELOP DISCRIMINATIVE FEATURES FROM WHEAT SPECTRAL DATA ACQUIRED 
THROUGHOUT THE GROWING SEASON 

• To DEVELOP IMPROVED UNDERSTANDING pF THE SPECTRAL CHARACTERISTICS OF 
WHEATS AS A FUNCTION OF: 

- Date and crop calendar 

- Observation conditions 

- Meteorological parameters 

- Agronomic factors 
Approach 

f Analyze available data 

Field measurement data 

Landsat data from lac IE and LAC I E-transition sites 

• Synthesize and begin to use a spectral phenology model for wheat 


APPROACH TO SPECTRAL PHENOLOGY MODEL FOR WHEAT 

• Formulate overall structure 

• Acquire state-of-the-art (SOA) or near-SOA submodels 

- WHEAT growth MODEL 

- CROP REFLECTANCE MODEL 

- ATMOSPHERIC EFFECTS MODEL 

- SENSOR MODEL 

- PREPROCESSING MODEL 

t Develop required interfaces 

• Obtain INPUT and test data 

• Implement and test the synthesized model 

§ Begin use of the model in developing objective techniques for 
labeling multispectral scanner data 
0 Update as improved submodels become available 
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CONDITIONS 
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"SEED-TO-SATELLITE" MODEL 


4- Turner Radiative Transfer Model 


^ Suits Bidirectional Canopy Spectral 
Reflectance Model 


Ritchie Wheat Growth Model 


meteorological & AGRONOMIC 

ANCILLARY VARIABLES 











PLANNED ACTIVITIES (18 MONTHS) 

Synthesis of the model 

Testing and validation^ using: 

- USDA field measurement data 

- LACIE FIELD MEASUREMENT DATA 

" Possibly^ LACIE intensive test site data 

Acquisition of meteorological data (e.g.> over 30 years) 

- Daily maximum and minimum temperatures 
“ Daily precipitation 

- Solar radiation or cloud cover> as available . 

Principal component characterization of meteorological data should provide 
“ Baseline scenario 

- Limited number of deviant scenarios^ yet representative of major 


variability 


ANALYSIS OF FIELD MEASUREMENT DATA 


Data Set Determination 


Measured AND PROVIDED BY: 

- Dr. Raymond Jackson^ et al/ USDA 

^ U.S. Water Conservation Laboratory^ Phoenix^ Arizona 
Experiment designed to determine water stress effects on wheat 
YIELD (1977-1978 growing season) 

Experiment factors 

- Moisture treatment: six levels of irrigation 

-Crop: two wheat varieties and one barley 

(Note: Planting densities greater than normal for 
N. Great Plains) 

Spectral MEASUREMENTS 

- Hand-held Lands at-band rad iometir 

- Daily measurements^ weather permitting 
Agronomic measurements 

- Crop GROWTH STAGE (modified Feekes scale) 

- Leaf area 

- Stem length 

- Wet and dry weights 


ANALYSIS OBJECTIVES BEARING ON CHOICE 
OF FEATURES FOR DISCRIMINATION 

0 To DETERMINE SPECTRAL DEPENDENCE ON GROWTH STAGE AND DATE 
0 To DEVELOP IMPROVED METHODS FOR INTERPRETING REFLECTANCE DATA PATTERNS 
0 To DETERMINE CHARACTERISTICS OF GREEN MEASURES 
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TEMPORAL PATTERN OF REFLECTANCE IN TWO BANDS 

(Plot 3A^ Wet Treatment^ Smoothed Data) 
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DEPENDENCE OF WHEAT SPECTRUM ON ~ 
GROWTH STAGE AND DAYS SINCE PLANTING 
(PLOT 3A. WET TREATMENT) 
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NOTES : 

•Smoothed data values 

•Growth stage in modified 
Feekes Scale 
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GROWTH STAGES 
IN CEREALS 


-STEM EXTENSION 


•TILLERING 


STAGE 

STAGE 

0 
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Stage 

I 

•y 
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4 

5 

6 

7 

8 

0 

10 
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III 
II. 3 

n.3 

1 1-4 


Ouc shoot Ounnher of Ic;ivcs can be added) ‘brairding' ' I 

ncgiiining of tillering 

T'illcrs formed, leaves often twisted spirally. In some var- 
ieties of winter wheats, plants may be Vrcc|nng' or pros- 
trate 

lleginninpif the erection of the pseudo-stem, le.if-shcaihs 
beginning to lengthen 

P.seudo-stem (formed by sheaths of leaves) strongly 
erected 


Tillering 


Fir.st node of stem visible at base of shoot 
Second node ofstem formed, ne\t-to-last leaf just visible 
Last leaf visible, but still rolled up; car beginning to swell Stem 
L igule of last leaf just visible f Extensio.V 

Sheath of last leaf completely grown out, car .swollen but 
not yet visit) Ic 


First cars just visible (awns just showing in barley, car 
escaping through split of .sheath in wheat or oai.s) 

10.2 (iiiarter of heading process completed 

10.3 Half of heading proce.ss completed 

10.4 Three-quaiTei’.s of heading process completed 

10.5 All ears out of sheath 

1 0.5. 1 Heginning of (lowering (wheat) 

10.5.3 Flowering complete to top of car 

10.5.3 Mowering over at base of car 

10.5.4 Flowering over, kernel watery-ripe 


y Heading 


[ I'l.OWEKlNG 
j (Whe,\t) 


Milky-ripe 

iMcaly-ripc, contenis of kernel .soft but dry 
Kerne! hard (dilheult to (lividc by thumb-nail) 
Ripe for cut ling,. Straw dead 


1 ^ Ripening 



MODIFIED FEEKES SCALE 






SUMMARY OF OBSERVATIONS ON REFLECTANCE DATA 
FOR THE SIX PRODURA WHEAT PLOTS 


• A Well Defined Looping Pattern is Present in Smoothed Data. 

• Peak Infrared Band Reflectances Occurred Just Prior to Heading^ i.e.^ During 

Development of the Flag Leaf. 

• Reflectances Generally Decreased Proportionally Toward the Origin During Heading 

AND TO THE Milky-Ripe Stage ( 11 . 1 ). 

• Visible Band Reflectances then Increased Substantially Throughout Rest of 

Ripening Process^ with Smaller Decreases IN THE Infrared. 

• Moisture Stress Effects are Evident. 

•Lodging Effect is Pronounced. 

•Comparable Patterns Exist in Tasseled-Cap-Equi valent Variables. 

Cautions Regarding Generalizations: 

- Preliminary analysis 

- Single variety^ grown out of normal geographic region 
-Higher planting density than normal for N. Great Plains 


INTERPRETATION OP REFLEGTANGE DATA 


Principal Gomponent Analyses 

-Defined principal plane using all data 
-Defined soil line using soils data 

Approx i mated Iandsat Band-to.-Banjj- Galjjirat i on Rat ios- 

Produced Tasseled-Cap-Equ I valent \6^riables 

Computed Time Profiles for Several Different Green Measures 

- Some could differ from those of corresponding Landsat 
variables due to EFFECTS OF PATH RADIANCE 
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CRITERIA FOR SELECTING GREEN MEASURES 

§ Shape OF Time Profile 

- Usefulness for crop calendar shift calculations 

- Ease of fitting mathematical form 

- Emphasis of particular growth stages 
0 Stability 

- Low VARIANCE 

- Lack of sensitivity to certai n factors 
0 Correlation With Agronomic Variables 

0 Usefulness FOR Discrimination 







GREEN MEASURE 



GREEN MEASURE 



STATUS 

• Preliminary Analysis of Frequently Measured Wheat Reflectance and Agronomic 

Data has Clarified or Refined Knowledge of Growth Stage Dependence. 

. - Additional analyses planned 

- Additional data needed for generalizatjon 

• Insight GaI NED About Time Profiles of Green Measures 

- No SINGLE measure LIKELY TO BE OPTIMUM FOR ALL PURPOSES 

- Additional analyses planned 

- Landsat data needed for final characterization and selection 

• An Improved Approach for Analyzing and Interpreting Reflectance Data in Terms 

OF Landsat has been Established. 

-Additional discussion in next presentation ' 














LANDSAT SPACE, REFLECTANCE SPACE, AND THE TASSELED CAP 


Peter F. Lambeck 
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LANDSAT SPACE, REFLECTANCE SPACE, AND THE TASSELED CAP 

Objectives ^ 

• Understand The Relationship Between Data Values And 
Their Four-Dimensional Structure In Landsat Space 
And In Reflectance Space. 

• Acquire Insights About The Information Content Of 
Landsat Data (And, Potentially, Thematic Mapper Data) 
Pertaining To Crop Development And Identification. 









LANDSAT SPACE. REFLECTANCE SPACE. AND THE TASSELED CAP 

Approach 

• Relate Positions The Landsat Greenness Vs , Brightness 
Plane. T o Various Data Features 

- In-Band Signal Values 

- Band 7 to Band 5 Ratios 

- Other Features 

• Examine Similar (Or Equivalent) Relations In Landsat 
In-Band Reflectance Data 

• Improve Estimate Of Transformation From Re flectanc# Space 
To XSTAR Corrected Landsat Space 

- Principal Component Method . 

“ Regression Method Using ITS Field Measurements 

•’ Improved In-Band Reflectance Calculation 
■’ Spatially Varying XSTAR Correction 
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LANDSAT_ SPACE. REFLECTANCE SPACE. AND THE TASSELED CAP 

Recent Progress 


• Analysis Of Landsat In-Band Signal Values And Band 7 To 
Band 5 Ratios Relative To The Tasseled Cap Hyperplane Is 
Being Used To Develop Data Features Based On A Green Angle 
And a Brightness Radius. 

• Landsat In-Band Reflectance Data Has Been Found To Have 
99+% Of Its Variance Confined To Two Dimensions, 

• Senescing Vegetation Has Not Been Found To Lie Outside Of 
The Reflectance Data Hyperplane By Any Significant Amount. 

• A Mathematical Procedure To Relate Directions In Reflectance 
Space To The Tasseled Cap Axes. Based On An Analysis Of 
Principal Components Of Reflectance Data. Is Being Tested. 

• A Rigorous Regression Procedure To Relate In-Band Reflectance 
Measurements To XSTAR Corrected Landsat Signals Is Planned For 
The Near Future. 


Distribution 
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SIGNATURE CHARACTERIZATION 


Objectives 

• Develop methods for characterizing the spectral signatures 

OF CROPS^ INCLUDING COLLATERAL VARIABLES 

t Develop transforms that will reduce the variability or sensi- 
tivity OF signatures to changed locations and SCENE CONDITIONS 

• Use AVAILABLE data BASE WITH DEVELOPED METHODS TO SELECT THE 
MOST DISCRIMINATIVE FEATURES AND TO CHARACTERIZE THE SIGNA- 
TURES OF WINTER WHEAT^ SPRING WHEAT, AND MAJOR CONFUSIOH 


CROPS 


KEY ISSUES FOR SIGNATURE CHARACTERIZATION 

Application Requirements 

- Utilize AVAILABLE multitemporal acquisition histories 

- Accept a wide range of observation conditions 

Represent accurate likelihood functions of crops of 
INTEREST and confusion CROPS FOR THE AVAILABLE ACQUIS I 
TI ON HISTORIES AND OBSERVATION CONDITIONS 


KEY ISSUES FOR SIGNATURE CHARACTERIZATION (Ggntinued) 

Training Requirements 

Utilize AVAILABLE moltitemporal observations and inter- 
polate TO provide time continuous signatures 

- Utilize OBSERVATIONS representing a wide range of 
COLLATERAL CONDITIONS AND INTERPOLATE TO PRODUCE 
SIGNATURES CONTINUOUS WITH RESPECT TO THESE CONDITIONS 

Utilize a large number of randomly drawn observation sets 

IN ORDER TO ENSURE INCLUSION OF A ROBUST VARIETY OF PATTERNS 


SIGNATURE CHARACTERIZATION 


Approach 

Generalized Approach 

- Use generalized likelihood function 

- Seek MULT ITEMPORAL^ MULTISEGMENT> MULTIMODAL SIGNATURES 
(for WHEAT AND FOR NON-WHEAT) 

- Estimate missing data using temporal development profiles 

OR CONDITIONAL EXPECTATION 

Trajectory Approach 

- Select features 

- Characterize TEMPORAL DEVELOPMENT PROFILES 

- Seek NORMALIZING RELATIONSHIPS OR TRANSFORMATIONS 

“Develop TRAJECTORY SIGNATURES FOR WHEAT AND FOR 
THE MAJOR CONFUSION CR0PS> AS NEEDED 

- Identify time periods “hich are the most useful 
FOR CROP discrimination 




SIGNATURE CHARACTERIZATION 


Progress 


Generalized signature characterization 

• Determined that a multimodal gaussian conditional likelihood is 

THE PREFERRED CHOICE FOR REPRESENTING SIGNATURES. 

• Generated an alternative (conditional expectation) to Boullion's 

METHOD FOR ESTIMATING SIGNATURE PARAMETERS WHEN THERE ARE MISSING 
DATA VALUES 

• Formulated a methodology for combining this with CLASSY to provide 

MULTIMODAL SIGNATURES INCORPORATING COLLATERAL VARIABLES. 

• Began an investigation of the modification and use of CLASSY 

(or all alternative GAUSSIAN CLUSTERING ALGORITHM.) TO CARRY OUT THE 
SIGNATURE ESTIM/'^ION USING A LARGE AMOUNT OF INPUT DATA 








LABELING PROCEDURES AND TECHNIQUES- 

Objective 

Utilize fhe UNDERSTANDING and discriminative features 

DEVELOPED IN FEATURE DEFINITION AND SIGNATURE CHARAC- 
TERIZATION TO DEVELOP AND EVALUATE TECHNIQUES AND TOOLS 
FOR LABELING LaNDSAT SCENE FEATURES. 





LABELING PROCEDURES AND TECHNIQUES 

Approach 

Analyze and Develop Image Products and Aids 

- Develop understanding of PFC color production system 

.. Consider psycho-physical characteristics of PFC color space 
.. Examine alternative colorimetric approaches 
-Develop a color mapping approach to production of image products 
Utilize normalized data 

Employ data-to-color in place of channel-to-primary. mapping 
.. Consider additional color aids and enhanced images 

- Develop Procedure M ANALYST AIDS 


Approach (Continued) 

0 Develop Objective Labeling Procedures 

- For winter wheat and/or spring small grains 
. . Follow two parallel approaches 

- BUILD ON LIST TECHNOLOGY AND USE OF Als 

- DEVELOP MACHINE-ONLY OR PREDOMINANTLY MACHINE PROCEDURES 

.. Use an iterative development process from conceptualization through 

THE MAJOR ELEMENTS OF THIS TASK AND T&E 

- For refined machine labeller for spring wheat vs. barley 

.. Based on previously reported T&E results^ identify potential error 
sources and diagnostics and iterate THROUGH THE MAJOR ELEMENTS OF 
THIS TASK 

.. To BE DISCUSSED IN DETAIL LATER 

0 Identify Labeling Error Patterns 

- Study LACIE and transition-year accuracy assessment results 

- Study test and evaluation results for LIST 

- Study test and evaluation results for Procedure M 


ADVANCED IMAGE PRODUCTS 


Progress 


• Conducted Evaluation of PFC Color Production Characteristics 

- Evaluated standard LACIE false color image products 

- Applied principles of color science to evaluate PFC 

CHARACTERISTICS 

• Experimental Imagery is Being Prepared; 

- Mapping Tasselled-Cap features into a plane of the 
L*> A*> B* Uniform Color Space 

- Main differences from our previous examples: 

•• New plane expands brightness equally with greenness^ 

PROVIDING A BETTER BRIGHTNESS RESOLUTION THAN STANDARD 
IMAGE PRODUCTS 

••Approximate zero reflectance point is mapped to extrapolated 
"BLACK" (outside THE ACHIEVABLE PFC RANGE) 

• Evidence From Preliminary Imagery Indicates That Standardized Data Can 
Be Portrayed With A Color Mapping That: 

- Is FIXED ACROSS THE GROWING SEASON 

- Has adequate color resolution 

- Is FREE OF TRUNCATION DISTORTION 

• Developed Research Versions of Procedure M Analyst Aids 


REFINEMENT OF- -A-HAGW NE- 
TECHNIQUE FOR DISTINGUISHING SPRING WHEAT 
FROM OTHER SPRING SMALL GRAINS 


ERIC P. CRIST 
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OBJECTIVES OF REVISION EFFORT 



• Increase the Geographic Range qe Effectiveness of the 
Spring Wheat/Other Small Grains Labeler 

0 Arrive at Results in Landsat Space That are Correlated 
TO Observable Phenomena on the Ground 



PROGRESS 


• Modified Crop Calendar Shift Procedure to Estimate 
AND Use Segment Specific Profile 

• Identified Spectral Effects^ in Reflectance and 
LaNDSAT SPACE/ OF MoiSTURE STRESS AND SOIL 
Brightness 

t Formulated Mechanism for Adaptation of Labeler 
TO Moisture Stress and Soil Brightness Effects 


TECHNICAL BACKGROUND 


• Preliminary Steps 

- Distinguish spring small grains from other crops 

- Screen segments for adequate acquisitions 

§ Original Labeling Procedure - ~ 

- Estimate crop calendar shift 

- Assign label based on a characteristic distance- 
in Tasselled-Cap Brightness-Greenness space 


GREENNESS 
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EXAMPLE OF CROP CALENDAR SHIFT ESTIMATION --LANDSAI DATA 
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EXAMPLE OF CROP CALENDAR SHIFT 

(Continued) 


Shift With 
Reference Profile 


Shift With 

Segment - Specific Profile 
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APPROACH 

• Develop Hypotheses 

t Identify Pertinent Physiological 

Relationships^ Effects 

i Model Canopy Reflectance 

• Analyze Field Measurements Data 

• Analyze Landsat Data 
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1. DEVELOP HYPOTHESES 


PURPOSE: Provide Initial Focus and Direction 
FOR Research Process 
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PRELIMINARY HYPOTHESIS 


• Distinct. Geograph I e Separation of "Good" and "Bad" Results 

Suggests Crop Signature Variations Caused By 

- Moisture Stress 

- Variations in Soil Brightness 














2. IDENTIFY PERTINENT PHYSIOLOGICAL RELATIONSHIPS. EFFECTS 

PURPOSE: Identify Crop Responses TO a Given Condition 
(e.g.. 'Moisture Stress). With Particular Attention 
TO Those Responses Likely to Influence the Crop 
Signature 


PHYSIOLOGICAL EFFECTS OF MOISTURE STRESS 


Impact OF Inadequate Moisture Varies Significantly With 

- Stage of crop development at initiation 

OF STRESS 

- Duration of stress 

Effects of Prolonged Moisture Stress Include 

- Reduced plant height 

“ Reduced number of tillers per plant 
“ Thinner^ smaller leaves 
“ Leaf rolling^ wilting 
“ Reduced stand density 
“ Increased development rate 


3. MODEL CANOPY REFLECTANCE 


PURPOSE: Understand the Likely Effects of Relevant 
Physiological Changes on Crop Reflectance 
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CANOPY MODELING 


Three Soil Brightnesses 

Two Canopies (Intervals from Emergence to Harvest) 
"Normal" PARAMETERS derived from field 

'MEASUREMENTS 

- "Stressed" modification of normal parameters 

TO SIMULATE EFFECTS OF PROLONGED MOISTURE STRESS 

Results are Qualitative^ i.e.j Show Trends Rather Than 
Absolute Numbers 

- Inputs are estimated 

- Greenness and Brightness are derived from 

PRINCIPAL COMPONENTS IN REFLECTANCE SPACE — 

NOT PERFECT MATCH TO LaNDSAT TaSSELED CaP 


2Fiiiiii 


CANOPY MODELING RESULTS 


SOIL BRIGHTNESS EFFECTS - NORMAL CANOPY 


• Greenness^- No Significant Impact 



Dark Soil 




BRIGHTNESS 


iv 
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CANOPY mDELIIIG RESULTS 

SOIL BRIGHTNESS EFFECTS - NORMAL CANOPY 

(Continued) 

f Brightness - Significant Impact in Tails of Profile 
Where Canopy is Most Open 


Bright Soil 
Medium Soil 
Dark Soil 
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CANOPY MODELING RESULTS 

MOISTURE STRESS EFFECTS 

(Continued) 


0 Brightness ^ Variable Impact - Enhances So il Br i^htness Effects 
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CANOPY MODELING RESULTS 
MOISTURE STRESS EFFECTS 
(Continued) 

• Distance 

- Overall INCREASE 

- Elimination of constant-value center portion 

ON 








• Soil Brightness Effects 

- Greenness - none 

- Brightness - tails of profile 

- Distance - increased slope in tails of profile 

§ Moisture Stress Effe^s ' 

“ Greenness - reduced peak 
^ - Brightness - enhanced soil brightness effects 

- Distance - overall increase^ earlier departure 

FROM MINIMUM 



4. ANALYZE FIELD MEASUREMENTS DATA 

PURPOSE: Provide Canopy Model/Real World and Ground/Satellite Links^ 
Observe Ranges of Natural Variability 


FIELD MEASUREMENTS 

• Primary Uses in This Effort 

- Confirmed results of physiological effects study 

- Supported canopy modeling work 

•• drove inputs 

•• PROVIDED CONTEXT FOR CHECKING RESULTS 

- Combined with field experience/ provided direct 

LINK TO GROUND PHENOMENA 
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5. ANALYZE LANDSAT DATA 


PURPOSE: Assess Utility of Spectral Relationships 
Observed in Model and Field Data> Derive Viable 
Procedure for Their Use 
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LANDSAT DATA ANALYSIS 


Model and Field Results Suggest the Following Relationshlrs: 

Spectral Detection Effect gn Distance 
Phenomenon Mechanism Decision Line 

Moisture Stress Green Peak Earlier Time Period 

Bright Soil Early Brightness Steeper Slope 








LANDSAT MTA ANALYSIS 

(Continued) 


§ Clear Correlation Between Peak Greenness 
AND Time Period of Separability 
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TIME PERIOD OF SEPARABILITY 
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PROCEDURAL IMPLEMENTATION OF REFINED TECHNIQUE 



• Label Spring Small Grains 

• Screen Segments 

- Adequate number and timing of acquisitions 

- Unusual behavior 

• Estimate Crop Calendar Shift 

- Also provides segment specific greenness profile 

• Flag Segments With Low Green Peak - Moisture Stressed 

t Compute Mean Brightness for Small Grains 
“ Shifted Days 110-120 

§ Modify Decision Line as Indicated by Green Peak and 
Early Brightness 

f Assign labels 



% CORRECT % CORRECT 


LANDSAT DATA ANALYSIS 
LABELING RESULTS 

A: Original Labeling Procedure 
B; CrTiMUM Linear Discriminant 
C: Revised Labeling Procedure (Preliminary) 


: Spring Wheat 

: Barley 




LANDSAT DATA ANALYSIS 
DETAILED LABELING RESULTS 


Original Labeling Optimum Linear Revised Labeling 

Procedure Discriminant Procedure (Prelim.) 



Ground Truth 

SPW/OSMG 

% Correct 

SPW/OSMG 

% Correct 

SPW/OSMG 

% Correct 

1498 

Spring Wheat 

806/239 

77.1 

846/220 

79.4 

802/264 

75.2 

Barley 

114/310 

73.1 

134/283 

67.9 

116/301 

72.2 

1515 

Spring Wheat 

2597/449 

85.3 

2805/551 

83.6 

2795/561 

83.3 

Barley 

421/2033 

82.8 

737/2022 

73.5 

801/1958 

71.0 

1640 

Spring VIheat 

4593/971 

82.5 

4493/1077 

80.7 

4601/969 

82.6 

Barley 

909/1363 

60.0 

770/1497 

66.0 

822/1445 

63.7 

1669 - 

Spring Wheat 

11/384 

2.8 

231/51 

81.9 

242/40 

85.8 

Barley 

10/261 

96.3 

75/102 

57.6 

81/96 

54.2 

1800 

Spring Wheat 

41/34 

54.7 

55/20 

73.3 

44/31 

58.7 

Barley 

133/871 

86.8 

315/679 

68.3 

278/716 

72.0 

1929 

Spring Wheat 

4/1346 

0.3 

678/312 

68.5 

662/328 

66.9 

Barley 

1/545 

99.8 

147/232 

61.2 

139/240 

63.3 
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CONCLUSIONS 


• Important Factors Influencing Crop Signatures 
Can Be Detected Using Landsat 

f Adaptation OF THE Spring Wheat Labeling Technique 
IN Response to Changes in Those Factors Substantially 
Improve Labeling Accuracy 

00 

00 

• Crop Calendar Shift Estimation Significantly 
Enhances Prospects for Understanding Crop Signatures 
AND Developing Viable Labeling Procedures 


231111 
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PLANS 


f Define RvLationshi PS Between Soil Brightness 
AND Decision Line Slope and Peak Greenness 
AND Time Period for Labeling Utilizing a More 
Extensive Data Base 

• Install Refined Labeler in Procedure M 
§ Test and Evaluate Refined Labeler 
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MACHINE TASK 

• Major Elements 

- Data Normalization Studies 

- Stratification^ Sampling and Estimation 

- Test AND Evaluation 

- System Error Model Development 

- Advanced Technology Studies 

• Focal Points*. 

- Landsat 1 1 1 

- Procedure M 

- Wheat 
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ELEMENTS OF MACHINE PROCESSING 


Data Normalization Studies 
- Analyze Landsat 3 spectral data structure 


w-viwE Landsat 2 calibration drift 


Stratification^ Sampling an^bEsii mat ion 
- Evaluate alternative spectral stratification techniques 
Reduce bias due to current Procedure M sampling strategy 


Examine alternative estimation strategies 


Test AND Evaluation 

- Examine analyst labeling in a field-target environment 

- Evaluate spring wheat configuration of Procedure M 

- Explore multicrop application of Procedure M 


Transfer Procedure M technology to JSC 


System Error Model Development 


Represent ERROR sources in Procedure M analytically 


Determ i ne performance measures 


Advanced Technology (candidate topics) 
Registration of multi -temporal data 


Full-frame sampling environment 


Crop inventory in problem areas (small fields^ cloud cover) 
Conceptualization of early warning 








LANDSAT-3 TO LANDSAT-2 CALIBRATION TRANSFORMATION 

Objective 


• Determine a multiplicative and additive transformation 

WHICH ALTERS LaNDSAT-3 DATA TO SIMULATE LaNDSAT~2 DATA 

f Obtain sufficient accuracy for the transformation so 
THAT SCREEN AND XSTAR will apply to Landsat-3 data in 
A MANNER WHICH IS EQUIVALENT TO THEIR LaNDSAT-2 


performance 


STEPS IN THEJEyELOPMENT OF A LANDSAT 3-2 CALIBRATION TRANSFORMATION 

• Obtained Data for 31 9-Day Landsat 3-2 Acquisition Pairs 

• Calculated Scene Diagnostic Values for Each Acquisition 

- (Green Arm Mean + Soil Mean)/2 

- Scene Mean "Yellow" Value 

• Calculated Initial Least Squares Estimate of Transformation 

• Eliminated 10 Pairs With Excessive Residual Errors^ 

Presumably Caused By Scene Effects: 

- Dissimilar Haze Conditions ("Yellow" Values) 

- Dissimilar Scene Development 

- Other Causes? 

• Recalculated Estimate of Transformation Using 21 Remaining _ Pairs 

• Produced Final Estimate of Transformation Using Merged 9-Day 
Pair Cluster Means (To Represent a Wider Signal Range) 

- Misregistered clusters were mostly avoided 

IN THE ESTIMATION PROCEDURE 


RESULTS AND EVALUATION OF THE LANDSAT 3-2 CALIBRATION TRANSFORMATION 

t The following, purely multiplicative transformation appears to be ade- 
quate AND IS recommended: 

( 1.1371 
1.1725 

1.2m 
1.1260 

- Coefficients DIFFER by 2 to 6% from Goddard prelaunch estimate 
EXCEPT for band 6 (DIFFERS BY •»'18%) 

- Transformation is roughly similar to LEC transformation (differs by 
2 to 6%) 

• Corrected Landsat-3 data has Tasseled Cap components which are similar 
to Landsat-2 components 

f SCREEN AND XSTAR perform reasonably on the corrected Landsat-3 data 



STRATIFICATION. SAMPLING AND ESTIMATION 


Objective 


Develop a stratification, sampling and estimation 
Framework IN which to evaluate problems assoicated 

WITH MULTICROP INVENTORY 









STRATIFICATION. SAMPLING. ESTIMATION 


Approach 

• Utilize Procedure M as a test-bed 

• Reduce Bias Caused by Spatial Sampling 

- Evaluate alternative feature extraction algorithms 

- Examine techniques to sample little blobs 

• Examine Alternative Spectral Stratification Strategies 

- Evaluate dynamic approaches 
.. Unsupervised approaches 

. . Tolerance block approaches 

. . CLASSY 

- Consider static approaches 
.. Designated other 

..Static spectral stratification 
0 Evaluate Alternative Estimation Strategies 

- Evaluate potential of classifiers based on linear rule 


STRATIFICATION. SAMPLING. ESTIMATION 

Progress 

• Study of tolerance block approach to spectral stratifi- 
cation conducted 

f Alternative algorithm to BLOB developed 
0 Procedure M configuration utilizing small fields designed 
0 Estimation configuration using ERIM optimum linear decision 

RULE DEFINED 



DEVELOPf€NT OF ENHANCED BLOB ALGORITHM (SuperB) 


t Successor of BLOB 
f Attributes 

- Quasi-fields are contiguous 

- Larger fields are not disconnected 

- More efficient algorithm 

• Distance measure replaced by contiguity criterion 



REPRODUCIBILITY OF THE 
ORIGINAL PAGE IS POOR 




FEASIBILITY OF SAMPLING SMALL FIELDS 
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(little blobs masked as periods) 


(big blobs masked as blanks) 





CONCEPT OF STATIC STRATIFICATION 


PROBABILITY INTERVALS 



Delta Strati fier 


Sample n « p(1-p)A 


probability contours 



Single Time 


probability features 



Multiple Time 


Using BLIND site data partitioned qualitatively by crop 

STRESS CONDITIONS ETC. DETERMINE PRIOR PROBABILITY THAT 

'wheat' appears in each strata 
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STUDIES IN STRATIFICATION TO REDUCE SAMPLING VARIANCE 

Wyman Richardson 
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PROCEDURE M - 

• Clusters Pixels Spectrally and Spatially Into 
Field-Like Groups Called "Blobs'- 

• Clusters Blobs Into Spectral Strata 
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OBJECTIVE; . 

Improve Spectral Stratification 






2?RM 
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OBJECTIVE: 


Improve Spectral Stratification 

APPROACH: 

Tolerance Block Clustering Algorithm 




FIRST CUT TO CREATE TOLERANCE BLOCKS 




R.V. = 




I’ T • T V J- r 


L 


NP(l-P) 


N j * N UMBER OF PIXELS IN STRATUM I 
N = NUMBER OF PIXELS IN THE SEGMENT 
Pj = PROPORTION OF WHEAT IN STRATUM I 
P = PROPORTION OF WHEAT IN THE SEGMENT 


R.V. VfiTH Integer Allocations 

i:(4 ^ 

p(l-p) 


NUMBER OF PIXELS IN STRATUM T OR SEGMENT 
PROPORTION OF WHEAT IN STRATUM I OR SEGMENT 


NUMBER OF SAMPLE BLOBS IN STRATUM I OR -SEGMENT 


yFiiM 
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PERFORMANCE MEASURE: 



The fixed-sample R.V. 



p,(i-p,) 




P(l-P) /B~A\ 

"~A \FT/ 


Nj = NUMBER OF PIXELS IN STRATUM I 
Pj = PROPORTION OF WHEAT IN STRATUM I 
Aj = NUMBER OF SAMPLE BLOBS IN STRATUM I 
Bj = NUMBER OF BLOBS IN STRATUM I 




EXPERIMENT 


• 3 Clustering Algorithms 

- BCLUST 

- Tolerance Blocks 

- Clusters Seeded By Block Means 

• 12 Kansas Blind Sites 

• Winter Wheat Estimation 

• 3 Biowindows 

• Brightness And Greenness From Each Biowindow 
•Sample Of Size 100 Blobs Assumed 



Number Of Clusters 


22 

30 


40 


50 


60 


70 


80 


90 


.500 .525 

100-Sample R.V. 


.550 


BCLUST PERFORMANCE AS A FUNCTION 
OF THE NUMBER OF CLUSTERS 


Ihiiii 
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NUMBER OF CLUSTERS 




16 


O 


2 ^ • 


O 


32 • O 

36 • G 

40- O 

O 
O 

60 • O 


48 • 
54 • 


72 • O 

81 - O 


96- 

I I I 

.510 .520 .530 

100 - SAMPLE R.V. 

PERFORMANCE OF BLOCK SEEDS AS A FUNCTION OF THE NUMBER 

OF CLUSTERS 


O 

.540 .550 


ytRu. 
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NUMBER OF CLUSTERS 


16- 




0 


2A' 

i 



o 



32 


0 




36- 


0 




40 


- 


0 


48 

G 





54 


0 




60- 





o 

72 




0 


81- 





o 


96- O 






t 1 

.580 .590 

1 

.600 

.610 

.620 .630 

.640 

■.650 


100 - SAMPLE R.V. 

PERFORMANCE OF BLOCKS AS CLUSTERS AS A FUNCTION OF THE NUMBER OF 

CLUSTERS 

)erim 
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COMPARISON OF 3 CLUSTERING ALGORITHMS 
AT THEIR OPTIMAL NUMBER OF CLUSTERS 
PERFORMANCE MEASURE IS lOO-SAHPLE R.V. 


SEGMENT 

BLOB INTERIOR 

BCLUST 

BLOCK SEEDS 

BLOCKS 


R.V. 

40 Clusters 40 Clusters 

48 Clusters 

1020 

.039 

.181 

.217 

.239 

1035 

.187 

.624 

.560 

.578 

1165 

.20A 

.832 

.922 

.872 

1851 

.155 

.383 

.404 

.495 

1852 

.136 

.423 

.454 

.614 

1861 

.090 

.355 

.389 

.396 

1865 

.086 

.610 

.580 

.615 

1886 

.168 

.502 

.452 

.532 

1163 

.283 

.622 

.621 

.725 

1167 

.178 

.652 

.614 

.813 

1860 

.195 

.385 

.361 

.420 

1887 

.168 

.643 

.588 

.758 

Average 

.153 

.518 

.514 

.588 

Average 

Difference 


.004 

-.074 

T 



.31 

■3.47 

Significance 

NOT 

SIGNIFICANT SIGNIFICANT AT .005 
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INFORMATION THEORETIC PERFORMANCE MEASURES 
(W. A. Mali la) 


# Conjecture: The Well-Developed Principles Of Information Theory Should 

Be Applicable To Evaluation And Design Aspects Of Infor- 
mation Extraction And Area Estimation Systems That Use 
Remotely Sensed Data. 

• Objectives: Determine The Validity Of The Conjecture And^ If Valid: 

— Develop Performance Measures That Supplement 
Or Parallel Current Measures 
— Consider System Design Implications 




INFORMATION THEORETIC PERFORMANCE MEASURES (Continued) 

Approach 

• View Information Extraction Systems As Communication Channels With: 

- Scene-Dependent Input Information 

- "Noisy" Processing Systems That Lose Information 

And/Or Introduce Errors 

- Output Information That Ideally Would Match That 

OF The Input 


imiL_ . . -j:ham n el _ output 


Characteristic 
Of Observed 
Scene 

Observations y 

Information 
Extraction And 
Processing 
System 

\ 

Derived 

Or 

Estimated 

Characteristics 

/ 

/ 








PROGRESS 


• Established The Approach And Viewpoint 

• Developed A Candidate Measure of Stratification 

Performance And Performed Limited Testing 
In Procedure M Tests 

• Developed Additional Candidate Measures 

• Began Consideration Of Other Aspects 
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BASIC CONCEPTS 




The Self Information Associated With The Occurrence Of State Xj Which Occurs 
With Probability P(Xj) is Defined To Be: 

I(x,) = LOG „; -- r = - LOG P(X,) 

^ P(Xj) * 

(The more rare the event^ the greater is the amount of information 

ASSOCIATED WITH ITS OCCURRENCE) 

Entropy Is The Average Amount Of Information Associated With Repeated 
Observations of A State Variable: 

M 

H(X) = -^2 LOG P(Xj) 

1=1 

(^MAX ^ OCCURS WHEN P(Xj) = 

Mutual Information Is The Expected Average Information Exchanged From 
Input X to Output Y 

M N / p(y I V 'I 

1=1 j=l ^ 


2mi* 




Average 

(Self) Information 
Content of Input 
H(X) 


Average 

(Self) Information 
Content of Output 
H(Y) 


Average 

Transmitted 

Information 


Mutual 

Information 

I(X;Y) 




Equivocation 
or Average 
Information Loss 


h(x[y) 


Average Error 
in Output 
H(Y|X) 


H(X,Y) 


DIAGRAmATIG REPRESENTATION INFORNATION 

RELATIONSHIPS FOR TK'O VARIABLES 







CANDIDATE PERFORMANCE MEASURES 

(Normalized Mutual Information) 


• Common Character I STT cs 

- Stratum Proportions Substituted for State Probabilities in Calculations 

- Maximum Value = 1 Indicates No Information Loss and/or No Error 

- Minimum Value = 0 Indicates No Information Transfer 

- Direct Application to More Than Two Classes 

• Candidate Normalization Terms (and Measures): 
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PLANS 


• Assess The Utility Of The Candidate Measures For 

Evaluating Stratification Performance 

• Continue The Development And Applications Of 

Information Theoretic Measures and Concepts 



ERROR MODELING 


Objectives 


Develop A CONVENIENT representation of error sources and propagation in Procedure M 
Broaden TO INCLUDE A GENERIC class of area survey remote sensing systems 
Investigate FUNDAMENTAL LIMITS on accuracy of systems 


2Eldll 
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ERROR nODEt 


Approach 

• Identify THE major conceptual stages at which errors arise or are propagated 

• Construct analytical models of the error sources and propagation 

• Fit the parameters of these models from experiments to produce empirical 

PREDICTIVE MODELS 













STAGES IN PROCEDURE M WHICH ARE THE 
SUBJECT OF AN ERROR MODEL 



L_ 

The dashed lines surround the components for which 

ERROR MODELS HAVE BEEN FORMULATED. 
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SYSTEM ERROR MODEL - 

Progrlss 

Procedure M Models Formulated; 

§ System BIAS AND variance as function of known Type I and Type II ePxRor 

RATES^ AT THE STRATA LEVEL. 

• System bias and variance as function of mean and covariance of Type I and 
Type II error rates^ at the strata level. 

• Labeling error model: represents Type I and Type I 1 error rates ^ 

FUNCriON OF COLLATERAL OBSERVABLES (e.G.^ BLOB SIZE AND SHAPE^ AC'JU) S ITIONS 
used in BLOB^ ACQUISITIONS USED BY ANALYSTS). ThIS MODEL WILL BE FIT TO 
LABELING EXPERIMENT RESULTS AND TO EXPLAIN THOSE RESULTS. ThE MODEL OUTPUT 
IS THE MEAN AND VARIANCE OF TyPE I AND TyPE II ERROR RATES. 

General Models: 

• Preliminary formulation of a model which gives bounds on maximum system bias 

FOR UNKNOWN TRUE PROPORTION AND UNKNOWN BUT BOUNDED TyPE I AND TyPE II 


LABELING ERROR. 


m 


TEST AND EVALUATION 

Objective 


Maintain clear indication as to portions of Procedure M 

THAT ARE MOST IN NEED OF IMPROVEMENT^ INDICATE CAUSES 
OR SOURCES OF ERROR> AND IDENTIFY THE NATURE OF PROBLEMS 
ASSOCIATED WITH EXPANDING LACIE-LIKE TECHNOLOGY INTO NEW 
CROP TYPE AND REGION ENVIRONMENTS 
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TEST AND EVALUATION 


Approach 

• Conduct Analysis of Analyst Labeling of Field Targets and Refined Spring 
Wheat Configuration of Procedure M 

- Design overall experiment 

- Define and evaluate role of analyst 

- Install refined spring wheat machine labeler 

- Conduct statistical and subjective analysis of sources of error 

• Explore FIulticrop Application of Procedure M 

- Apply to corn and soybeans using ground truth labels 

- Evaluate spectral separability through analysis of spectral strata 

- Evaluate field size attributes through analysis of spatial strata 

• Transfer Procedure M Technology to JSC 

- Provide available code^ test bench 

- Provide monitor interface between QLINE> LARSYS 

- Provide consultation 



TEST AND EVALUATION 


Progress 


Analyst Labeling /Spring Wheat Procedure M Evaluation Underway 

- Experiment designed 

- 18 SEGMENTS PREPROCESSED 

- Analyst labels for all big blobs in house 

- Preliminary analysis begun 

Major Strides In Procedure M Transfer Undertaken 

- Code transferred 

- Test bench provided 

- Monitor interface written 

- BLOB now operational 
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j 

ANALYST LABELING/PROCEDURE M EXPERIMENT i 

I 

Frank Pont I 
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ANALYST LABELING/PROCEDtJRE M EXPERIMENT 

Objectives 

• Understand AI Labeling Process In A Field-Labeling 

Environment. 

• Evaluate A Spring Small Grain Configuration Of 

Procedure M Using Analyst Labels. 

• Examine The Performance Of The Components Of 

Procedure M. 


ANALYST LABELING/PROCEDURE M EXPERIMENT 

Overall Approach 


OBJECTIVE ANALYSIS 

(Using Statistical Methods) 

• Evaluation Of Labeling Error 

As A Function Of 

— Analyst 
. ~ Spectral Strata 
~ Adjusted Planting Date 
— Acquisition History 
— Collateral Data 

• Evaluation Of Bias And Variance 
Characteristics Of System 

— Evaluate System Components 
- Evaluate System Performance 


SUBJECTIVE ANALYSIS 

(Using Analyst Interpreters) 

• Determine Causes Of A I Error 

And Inconsistency 

• Develop Operation Procedure M 

Mechanism 

• Evaluate Performance Of System 

Components 




AI LABELING PROCEDURE 


• Elements of procedure 

- 3 experienced lac IE analysts 

- - All big blobs for eighteen LACIE TY78 blind sites 

- PFC BLOB OVERLAYS^ LINE PRINTER MAPS 

- Standard LACIE LABELING POCKET 

- Comments forms 

• Procedure 

- Each SEGMENT LABELED BY EACH ANALYST INDENPENDENTLY 

- Analysts developed labeling stratey 

- Eight codes indicating grain^ nongrain and other 

CHARACTERISTICS ANNOTATED 

- Segment and overall comment forms filled out by analysts 


2«iii 
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SEGMENT COMMENT FORM FOR PROCEDURE M TEST 


1. Segment Number: 

2. Analyst Code: 


3. Date 


Start: 

Completed: 


4. Number of Hours Required for Labeling: 


5. Acquisitions: 

A. 

Acquisition 

Date 


Primary or Comments: (Suitability^ Usefulness^ 
Secondary or Reasons for Not Using) 


(use other side if needed) 

B. What are the deficiencies^ if any^ in the available acquisition history? 




SEGMENT COMMENT FORM FOR PROCEDURE M TEST (Cont'd) 


6. Comments ABOUT THE BLOB patterns: 

A. Do THE BLOB INTERIORS SEEM TO BE PURE? 

B. Do THE BLOB PATTERNS MATCH THE FIELD PATTERNS? 

C. Was the choice of blob acquisition optimal? If no, why? 
Which acquisitions should be used? 

D. Other comments ABOUT BLOB patterns: 


7. General Description of Segment. For example, moisture, field s^ 

TOPOGRAPHY, PERCENT AGRICULTURE, ETC. 


8. Did you have to change your procedure in order to handle this segment? 
If so, describe how. 

9. Other Comments: 


ANALYST OBSERVATIONS/COmENTS 


Strong Points 

•Blobs easier to label than dots 
•Blobs represent field centers rather well 

Problem Areas 

•Difficult to label 300 to AOO blobs 
•Small blobs (l-3 pixels) difficult to label 
•Blob does not work well in small or stripped fields 
•Mixed blobs occur 

•Acquisitions USED for blobbing not always optimum 
•Single blobs may be disjoint (difficult to label) 
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MAJOR COMPONENTS OF EXPERIMENT 


• Definition OF Field-Like Targets FOR Labeling 

• Definition Of Labeling Procedure 

I'l 

I Ij • Analyst Labeling Of Targets 

• Pre-Ground Truth Analysis 

- Use Statistical Test To Group Segments Into 

• -Those Segments In Which AI Labels Are Significantly Inconsistent and 

• -Those Segments In Which AI Labels Are Relatively Consistant 

- Use AI Provided Segment Information To Determine Cause Of AI 
Inconsistency/Consistency 

- Obtain Estimates For The Proportion And Standard Deviation Of Spring 

Small Grain And Spring Wheat 

• Ground Truth Analysis 

- Use Statistical Techniques To Determine Relationships Between A I 
Labeling Error and Collateral Data (Segment Strata and Blob Level) 

- Evaluate Error Propagation Through The Procedure M System And 
Its Components 


ANALYST LABELING ERROR MODEL 

Ground Truth Label 


Spring Non-Spring 
Small Small 

Grain Grain 

Analyst Label 

SPRING 
SMALL 
GRAIN 

NON-SPRING 
SMALL 
GRAIN 

If The Proportion Of Spring Small Grain Is P 

Then • The Expected Value Of The Proportion Of Blobs Labeled Spring Small 
Grain From A Sample Of Size a Is ap + 3(l-p) 

• The Expected Bias Is 

ap + 3(l-p) - P = (a-S-l)p+6 

• The Variance Is 

(a-a^) P+ (6-3^) (1-p) + P(]-p ) 

A 

WHERE A IS THE SAMPLE SIZE AND 
B IS THE NUMBER OF BLOBS. 


a 

3 

n~a 

.J. 1 

1-3 
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STRATUM AND SEGMENT ESTIMATES FOR e, AND P 


Denote The Labels From The AI/s As 


I^ukI ^ 1^2^ 3 


,18 

K Ij2j3j • • i^N I 


Nj= NUMBER OF BIG BLOBS IN SEGMENT J 


WHERE Cjj|^=l IF THE I^” ANALYST LABELS BLOB K OF SEGMENT J AS SPRING SMALL GRAIN. 


Otherwise^ 


The Estimates For 3^ and p for stratum s of segment j analyst i are 
- S'^KJ^IJK 


• a 


US 


Z 


^ SUM IS OVER ALL BLOBS K IS STRATUM S WITH GROUND 


W 


KJ 


TRUTH GRAIN 


^ SUM IS OVER ALL BLOBS K IS STR_ATUM S WITH GROUND 


Z 


W 


KJ 


TRUTH NON-GRAIN 


“ P 


US 




UK 


^ SUM IS OVER ALL BLOBS K IN STRATUM S 


E«k/ 


UK 


WHERE , IS THE NUMBER OF PIXELS IN BLOB K OF SEGMENT J. 


'KJ 
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STATISTICAL ANALYSIS OF THE EFFECT OF 
ACQUISITION HISTORY ON ANALYST'S LABELING 


Using a theoretical brightness-greenness trajectory for wheat blobs> 

planting/ EMERGENCE^ HEADING^ TURNING^ AND HARVEST DATES CAN BE 
ESTIMATED. ThESE DATES CAN BE COMPARED TO THE ACQUISITION DATES TO 
DEFINE ACQUISITION DEFICIENCIES. 


For 

BLOB 

K DEFINE X|Q=1 

IF 



Xk2=1 

IF 



X|Q=1 

IF 




IF 



Xk5=i 

IF 

We 

CONSIDER THE MODEL 



“Kl 

■ "0 ^ 

V2X, 


BLOB K HAS A PREEMERGENCE ACQUISITION DEFICIENCY 
BLOB K HAS AN EMERGENCE ACQUISITION DEFICIENCY 

BLOB K HAS A HEADING ACQUISITION DEFICIENCY 

BLOB K HAS A TURNING ACQUISITION DEFICIENCY 

BLOB K HAS A HARVEST ACQUISITION DEFICIENCY 


3X10 + + Y^Xj^J 


+ e 


Ki 


The TERMS Yq/y^^ ^ 2 ' ^ 5 ' ^5 be estimated using least squared 


REGRESSION. 
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STATISTICAL BETVIEEN-ANALYST COMPARISONS 


• Compute and Pjjg for each analyst-stratum combination of segment j. 

•We consider the models 


— a 


US 


- The 


= y'+ Tj + 

VARIANCES OF 


US' 


a 


US' 


^JS = ^* ^ V>^US' P 


AND Pjj3 DEPEND ON ot 


US 

I' 


= + t/" + e, 

I IJ 

Pj/ AND BLOB SIZE. 


~ The VARIANCES OF T(Sjjg)^ T(3jjg)y AND T(PjjgT DEPEND ONLY ON THE BLOB 
SIZES^ WHERE T(X) = ARCS IN (v'x) . 


- Weighted ANOVA is appropriate using a function of the stratum BLOB sizes as weights. 

• ANOVA Allows Us To Decompose The Sum Of Squares Into 

- Between Analyst Sum Of Squares 

- Within Analyst Sum of Squares 


• The F-Test Allows Us To Test The Following Null Hypothesis For Segment j. 



t"=t" = t ' = 0^ H": = 0 ^ and t'" = Q. 

12 3 0 1 2 3 ° 1 2 3 


• The Between Analyst Test Can Be Used To Group The Segments For Later Study 


Ijiiiiii 
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STATISTICAL ANALYSIS OF THE EFFECT OF SEGMENT GROUPING 

ON ANALYST LABELING 

• Group segment by various statistical and physiological criteria^ e.g.^ 

- AI CONSISTENCY 

- Drought stress 

• Group segments by analyst provided criteria 

- Perceived PHYSIOLOGICAL similarities 

- Perceived agricultural cropping practices 

• Evaluate error as function of segment groupings 


• Substantial progress is being made in conducting an experiment 
TO understand and evaluate analyst labeling in a field labeling 
environment and utilizing those labels in a Procedure M 

ENVIRONMENT. 

• Subjective analysis by analyst interpreters and analytical 

ANALYSES USING STATISTICAL METHODS ARE EXPECTED TO PROVIDE 
INSIGHT INTO THE SAMPLING-LABELING-ESTIMATION PROCESS. 
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ADVANCED TECHNOLOGY 

Objective 

• To Generate Viable Technical Options for Large Scale 
Agricultural Forecasting Systems Based on Remote Sensing 



ADVANCED TECHNOLOGY 


Approach 

Select a Few Study Topics Typical of Broad Problems 
Anticipated in the 1980-85 Time Frame 

Using Techniques of General Problem Solving Identify 
Key Technological Issues Which Have Potential to be 
Resolved 

Outline Conditions for Solution or suggest approaches 


TO SOLUTION 
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ADVANCED TECHNOLOGY 


Progress 


• Two Topics 

- Use of machine processing to extend label 

INFORMATION TO LARGE AREA 

- Concept of early warning 


• First Topic Has Identified Two Key Technical Issues 

- Estimation from priors based on collateral 

DATA WHEN SPECTRAL DATA ARE MISSING 

- Accurate registration techniques 


2eri«i 


KEY THOUGHTS WHICH WE WISH TO LEAVE WITH YOU 


• Agronomic Features and Variables are Encoded in Landsat Data Features. Understanding 
This Code is Central to Successful Labeling. 

• Different Features Carry Different Information. No Single Feature Can Satisfy All Needs. 

• Identifying Stage of Development is Critical to Successful Crop Discrimination. This 
Identification Can Be Accomplished. 

• Adaptation for Moisture Stress and Soil Brightness Variations is Necessary for Robust 
Labeling Procedures. These Conditions are Identifiable and Can Be Adapted To. 

• Landsat 3 Data is Scaled Significantly Different Than Landsat 2 Data. This Difference 
Can Be Corrected For. 

• There is a Real Cost Associated With Stratification Before Sampling. Even Breaking Even 
IN Sampling Variance Requires Some Finite "Purification" Performance by the Stratification 
Methodology. 

t Currently Demonstrated Stratification Performance Falls Short of the Apparent Potential. 

• Measures of Performance are Subtle Creatures. They Must Be Tailored to the Specifics 
OF THE Information Desired and the Environment Encountered. 

t The Tall Poles to be Overcome in Future Acreage Assessment: 

- Truly Objective Labeling 

“ Effective Stratification 

- Understanding of Errors 


ON KNOWLEDGE 


Appearances to the mind are of four kinds. 

Things either are what they appear to bej 
OR THEY neither ARE^ NOR APPEAR TO BEj 
OR THEY ARE AND DO NOT APPEAR TO BE; 

OR THEY ARE NOT> AND YET APPEAR TO BE. 

To HIT THE MARK IN ALL THESE CASES^ IS THE 
WISE man's task. 

Discourses of Epictetus 
Epictetus of Hieropolis 
50 B.C. - 30 A.D. 

"There's No Substitute For Signatures" 

H. Horwitz 1979 A.D. 



END 


